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HISTORY OF THE EXPERIMENT 



Part I 



CONCEPTION OF THE IDEA 

A series of foreign language conferences, held throughout the State 
of Colorado during the past three years, revealed widespread teachei^ 
interest in the nev/ approaches to foreign language teaching, indicating, 
the need for a continuing program of study and education to keep alive 
this newly awakened interest, as well as to encourage further study and 
professional growth. It is evident that the great majority of foreign 
language teachers on the secondary level can neither return for an in- 
tensive course of study at a college or university nor attend an NDEA 
summer or year-long institute. The development of an in-service pro- 
gram was requisite, to provide some of the more significant experi- 
ences of the Institute. The program would offer an opportunity to study 
while teaching and so would not deplete the teaching force. It would 
promote a type of professional growth not possible, for the student in 
a college course or the participant in a workshop. The teacher would 
be able to apply his new knowledge immediately, while developing 
meamngful contacts with his colleagues in the evaluation process, 
which, in turn, would help to maintain professional attitudes. The 
teacher’s own classroom woidd thus become a laboratory in which to 
refine his discoveries by applying and evaluating new theories and 
techniques immediately after encountering them. 

In this context was conceived the idea of a group technique for such 
learning. Groups of teachers would meet in their own districts to study 
recent theories of the nature of language and how it might be most effi- 
ciently learned and taught. . Together, they would examine new teaching 
materials, audio-visual aids, and equipment now available; evaLxate 
them; and share various ways of using them. To make these sessions 
more worthwhile, a syllabus, or study guide, would be developed, 
based on the new materials and approaches, including a section on the 
principles of group discussion. It would also contain a list of specific 
textbooks to be studied collaterally, a list of library references, and 
objectives for the entire course, as well as comments and discussion 
questions for each assignment. 

Because many of Colorado's school districts are distant from 
college or university campuses, the presence of an instructor,, in this 
case the Project Director, would have to be limited to two or three . 
meetings with the group, for the purposes of orientation and evaluation. 
A fellow teacher in the district who had formerly participated in an 
NDEA Summer Language Institute could be requested to assist in acting 
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as discussion moderator, and to serve as liaison between the group and 
the project administration in the pilot project. Effective guidance 
would require training in group leadership, which could be supplied by 
conferences with the Communications Consultant, as well as by the 
materials on group discussion as a learning method, to be incorporated 
in the study guide. 



EXPLORATORY STEPS 

Miss Dorothy Duhon, State Foreign Language Supervisor in Colo- 
rado, and Mrs. Lois Badger, Director of Correspondence Study at the 
University of Colorado, who, together, had conceived the concept of de- 
veloping an exportable course which could be used in group study as an 
in-service educational program, presented the idea to Dr. Dwight L. 
Bolinger, then professor of Spanish and linguistics at the University of 
Colorado. He was interested in promoting the project and promised to 
help find a qualified linguist who would be willing to develop the course 
materials for Spanish teachers. Miss Barbara Schindler, Director of 
Speech Services and Instructor in Speech at the University of Colorado, 
was pleased to assist with the group in anyway possible and to prepare 
the section of the study guide concerned with the method and technique 
of group instruction. Dr. Robert E. de Kieffer, Director of Audio- 
Visual Instruction at the University of Colorado, favored the idea and 
gave assurance of his cooperation in providing films, tapes, and other 
audio-visual teaching aids. He further suggested that, for such an edu- 
cational program, NDEA funds might be available to finance a pilot re- 
search project. 

To discuss the details of a major program and of organizing a po- 
tential, experimental, pilot project. Miss Duhon and Mrs. Badger ar- 
ranged a meeting with Dr. Bolinger; Dr. George A. C. Scherer, then 
director of the Academic-Year German Institute at the University of 
Colorado; Dr. de Kieffer; and Charles L. Bostrom, Chief of the Title 
UI Section of the Colorado State Department of Education. After some 
discussion of the Project, Dr. Scherer called Dr. Kenneth Mildenberger 
Head of the Language Development Section of the U. S. Office of Educa- 
tion, who agreed that a proposal should be prepared and submitted un- 
der Title VI, Section 602, National Defense Education Act of 1958. 

Dr. Bolinger then agreed to try to enlist the services of Dr. David 
M. Feldman, then teaching Spanish and Portuguese at Princeton 
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University, who was to be visiting lecturer in linguistics at the NDEA 
Summer Language Institute at the University of Colorado during the 
summer of 1962, With the subsequent assurance that Dr, Feldman 
would be willing to develop the materials, teach, and act as Project 
Director, a tentative proposal was prepared and presented to Dr, A: 
Bruce Gaarder, Head, Research and Studies Unit, Language Develop- 
ment Section, U, S, Office of Education, at the annual meeting of the 
Modern Language Association in Chicago in December, 1961. On Jan- 
uary 23, 1962, a final proposal, incorporating Dr, Gaarder’s sugges- 
tions, was approved by University officers and sent to Dr. Gaarder. 

The proposal was then discussed with school-district administra- 
tors in Colorado Springs, Colorado, which had been selected as favor- 
able for development of the pilot project: first, because the district 
and immediate environs included a sufficient number of secondary- 
school Spanish teachers to insure a voluntary group of more than ten; 
second, because some of the teachers in the district were former 
NDEA Summer Institute trainees who might act as discussion leaders; 
third, because Colorado Springs is a convenient distance from Boulder 
for purposes of observation and administration. Present at this first 
meeting were Dr. Thomas B. Doherty, Assistant Superintendent of 
Public Schools; Dr. Harold H, Threlkeld, Director of Secondary Edu- 
cation; Mr. Joseph M. Tockman, Supervisor in Secondary Education; 
Miss Joanna Jolly, a teacher in the district, with NDEA Institute train- 
ing (all of Colorado Springs); Mist> Barbara Schindler, Director of 
Speech Services at the University of Colorado; Miss Dorothy Duhon, 
State Foreign Language Supervisor; and Mrs. Lois Badger, Director of 
Correspondence Study at the University of Colorado Extension Division. 
The plan was not, at first, enthusiastically received by Dr. Doherty and 
-Dr. Threlkeld. They questioned the advisability of inviting teachers 
outside of their school district, the possibility of insufficient interest 
in the program, and even the necessity for such a program in that par- 
ticular district. Miss Jolly and Mr. Tockman were favorably im- 
pressed and, after Miss Schindler, Miss Dii^on, and Mrs. Badger ex- 
plained the advantages of the program, the decision was made to locate 
the experimental Project there. Final arrangements were to be con- 
summated before the end of the school year, 1962, since there were in- 
dications of a possible USOE contract for the Project. 

In mid-May, 1962, another meeting was arranged with the school 
administrators in Colorado Springs, which included Spanish teacherp 
from each of the secondary schools in the district, as well as the 
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personnel present at the previous meeting, with the exception of Miss 



Schindler. At this meeting, it became clear that there were misunder- 
standings about the aims and objectives of the pilot course. Dr. 
Threlkeld further objected because he could not see the need for an in- 
service program for teachers with years of teaching experience. He 
seemed to be \mwilling to ask or answer questions concerning the pro- 
fessional background of his teaching staff. Only upon the insistence of 
Miss Jolly, Mr. Tockman, and the Spanish teachers present that such 
a program was an immediate necessity were final plans discussed. At 
this meeting, as a concession to the administrators, it was agreed that 
teachers outside the Colorado Springs district would not be invited. 

Because of the late date, a move to another location was almost 
impossible to arrange. It was necessary to either proceed in Colorado 
Springs or abandon the Project until a more suitable atmosphere could 
be found. In an attempt to evaluate the candid attitudes of the adminis- 
tration, Deaii D. Mack Easton, University of Colorado Extension Divi- 
sion, wrote to Dr. Doherty to ascertain definitely the current feeling of 
the school administrators concerning the program and the possible wis- 
dom of conducting the Pilot Project elsewhere. Dr* Doherty immediately 
indicated the willingness of the administrators to cooperate and their 
pleasure in having the project there. On the basis of this response, 
immediately upon receipt of the contract from USOE on June 1, 1962, 



Dr. Threlkeld arranged a meeting of the Spanish teachers in the 
district, presented the plan, enlisted them in the program for the fall, 
and sent the list of participants to the Correspondence-Study Office at 
the University of Colorado. Although the group was now constituted and 
the program approved, an essential precept of the program was unavoid- 
ably violated- -that of the willing support of the local administration and 
the voluntary subscription of the group. 



ADVANCE PREPARATION 



The Project Director, who by then had arrived in Boulder, began 
the task of preparing the Study Guide on June 1, 1962, along with the in- 
troductory materials, the assignments themselves, and the scheduling 
of meetings. The Project Director contacted various state departments 
of education, for sample manuals, bibliographies, and reference lists. 



arrangements were rhade for the inception of the study sessions in the 



fall. 
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The formulation of a reference shelf of materials was immediately be- 
gun and the selection of teaching materials was completed. 

At the same time) the Communications Consultant began the prepa- 
ration of both the participants* section and the optional discussion 
leader’s section of the portion of the Guide concerned with learning 
through the discussion method. The Communications Consultant deter- 
mined the level and approach of both these sections, after several in- 
terviews with the prospective discussion leader, concerning both her . 
own experience and skills, and those of the participants, in the tech- 
niques of the discussion process. In addition, the materials pertaining 
^ process were thoroughly analysed with the leader, and 

additional suggestions offered in response to questions. 

From June 1, 1962, until the beginning of the fall semester (Sep- 
tember 17, 1962), a series of preliminary staff meetings were held in 
the offices of the Extension Division of the University of Colorado, in 
Boulder, to clarify all administrative details and to coordinate the pro- 
gram in general. Decisions were made as to printing of materials 
(mimeographing and plastic binding with stiff paper covers, by the 
Correspondence -Study Office); preparation and dubbing of tapes (by the 
Audio-Visual Bureau); ordering and distribution of textbooks (through 
Correspondence Study and Extension library); constitution of the refer- 
ence shelf, preparation of questionnaires; registration and accreditation 
of participants; liaison among the various state and city education offices 
3.nd SrgencisSt tcchnicarl considerations of classrooni and laboratory 
space, projection equipment, and personnel at the Colorado Springs lo- 
cation (Palmer High School). During these staff meetings, questions of 
appropriate personnel and procedures on the University campus were 
considered and Dean D. Mack Easton of the Extension Division assumed 
substantial responsibility for assistance with the Project Staff's rela- 
tions with the Finance Office and other agencies of the University. 

As each phase of the materials was completed throughout the sum- 
mer, the manuscripts were submitted to the Project Consultant, Dr. 
I^ight D. Bolinger, for annotation and criticism. Final administrative 
plans were submitted for consideration to the Dean of the Extension Divi- 
sion, the State Foreign Language Supervisor, and the administrative 
heads of the Colorado Springs school district and Palmer High School. 

A schedule of meetings for the participants was arranged, naturally 
taking. into account school holidays and other details of the secondary- 
school calendar which might have interfered with total participation. 
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' The list of participants, as formiilated by the Director of Secondary 
Education in Colorado Springs, was forwarded to Correspondence Study 
and the participants were duly registered for credit. The Correspond- 
ence-Study Office edited and duplicated the Study Guide and all other 
materials for distribution to the participants. 

Although a general reference bibliography was published in the 
Study Guide, it was felt that a special "recommended" list of books and 
articles should be included. The responses from a questionnaire, sent 
to approximately forty professors of applied linguistics and methodology 
in Spanish teaching, helped to determine the recommended list. Staff 
members of the University library aided in annotating the list. As a re- 
sult of this procedure, the basic list represents the opinions of a wide 
group of specialists, enabling funds earmarked for the reference shelf 
for the participants to be expended in the v/isest possible manner. The 
reference shelf was made available to the participants through the Uni- 
versity of Colorado Extension Center in Colorado Springs. The materi- 
als, at the participants’ request, are accessible there until mid- summer, 
when they are to be returned to the University and held, pendini? 
instructions from USOE. ^ 



PILOT COURSE BEGINS 

Orientation meeting , with participants, October 15, 1962 

At this first meeting, administrative details and procedures were 
clarified and the goals of the Project were explained, as well as the ex- 
perimental nature of the course. It was considered important for the 
participants to state their own individual goals and the benefits they ex- 
pected to receive from their experiences in the program. To encourage 
an atmosphere of frankness, the Project Staff also expressed, as can- 
didly as possible, their own hopes as to the outcome of the experiment. 
Along with a copy of the Study Guide, each participant received, from 
Dcet.n Easton, an explanatory letter of welcome to the program, which 
included a statement of goals and objectives.. Time was allowed for 
questions and comments, and attention was directed to another state- 
ment of, purposes, printed in the Study Guide. The hope was that this 
repetition of goals (of both the Project originators and the participants) 
would serve to fix them firmly in the participants’ memories, in order 
to avoid confusion later on. To enhance the atmosphere of friendliness 
and informality, each participant was given a name tag and asked to in- 
troduce himself, briefly. Participants were also urged to discuss their 
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daily classroom problems in the context of the day's assignment and to 
make every attempt to learn from one another. It was pointed out, both 
directly and indirectly, that the ability to learn from one another could 
well be the key to the program's success and their own individual 
achievements^ 

Testing 

The diagnostic MLA Proficiency Tests were administered during 
the first meeting, October 15, 1962, and following meetings. Dates 
were set for the administration of the post-tests in April, 1963. Re- 
sults and evaluations of the tests are given in an appendix to this report. 

Film s 

As prescribed in the contract, the MLA- Teaching Film Custodians' 
five-film series on language and language teaching were shown during 
the first five sessions. A special section of the Study Guide, allocated 
to written assignments and group discussion on the content of the films, 
endeavored to underscore the principles promulgated. The work papers 
accompanying the films also were used. (Upon the recommendation of 
the Project Staff, the Audio-Visual Bureau of the University of Colorado 
acquired the series, which subsequently has been almost continuously 
booked by a large number of institutions in the West. ) Once the princi- 
ples of the audio-lingual approach were firmly established, the Pierre 
Capretz-Yale University Spanish films were shown, available to all the 
teachers in the Colorado Springs district. 

Tapes 

Sets of practice and demonstration tapes were acquired and made 
accessible to the participants, both as examples of audio-lingual teach- 
ing materials and for use by the participants themselves in improving 
their own control of Spanish. 

Class procedures 

As is to be anticipated with new learning groups, this one was high- 
ly dependent upon the Discussion Leader and continually sought 
"answers" from the "teacher. " A variety of group discussion tech- 
niques were tried separately and in combination, in an effort to deter- 
mine which could best be recommended for future, independent, group- 
study plans. Among the more significant techniques attempted (evalu- 
ated in Part II of this report) were: 
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1. Each member of the group independently prepared each question 
based on the day’s assignment. Then, at the meeting, the independ- 
ently achieved answers were evaluated by the group. The Discus- 
sion Leader served as moderator, attempting to see that the group 
considered conflicting opinions, and in addition, to encourage par- 
ticipants to relate the assignment and questions to their own class- 
room situations, 

2. At each meeting, a different member of the group assumed the 
function of recorder, noting the agenda and principal points covered 
in the discussion. The purpose was to free other participants from 
detailed note-taking in order that they might participate more fully 
and freely in general discussion. At the end of the session, the re- 
corder was asked to read the notes aloud so that the group could 
add or amend in any way, thus insuring that it was an accurate 
summary of the consensus of the group, rather chan one person's 
version. Copies of the recorder's notes were duplicated and anno- 
tated by the Project Director, then returned to the participants at 
the following meeting. Again, the Discussion Leader functioned as 
general moderator, working on such problems as sustaining a suit- 
able climate and subtly attempting to equalize and encourage 
participation. 

3. Participants were asked to read the assignment and collateral ma- 
terials before coming to the meeting, so that the session could be 
used for the purpose of preparing group answers to the discussion 
questions. The Project Director then annotated the group answers 
and returned them, duplicated, as in 2, above. 

4. It was arranged that the Discussion Leader be absent from the 
group at significant intervals, in order to evaluate the ability and 
willingness of the group to work on its own and the quality of the 
work when carried out with no administrative supervision. 

Supervision by the Project Staff 

Both the Project Director and the Communications Consultant at- 
tended the first five meetings and the final sessions of the course, and 
were able to aid in the administration of tests and offer immediate ad- 
vice to the Discussion Leader. This facilitated flexibility in the order 
and manner of presentation of the material, necessary to, achieve close 
correspondence with the interests and needs of the group* as well as to 
evaluate group morale and opinion at frequent intervals throughout the 
experiment. The Project Director and the Communications Consultant 
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were thus enabled: (1) to evaluate the efficiency of the various discus- 
sion techniques used, as the course progressed; (2) to administer sam- 
ple tests and dibcuss the answers immediately, so as to demonstrate 
progress and clarify remaining points of difficulty; and (3) to commu- 
nicate directly with the participants, so as to observe immediate re- 
actions to the course procedures and reduce the participants' feelings 
of being isolated or hapless "guinea pigs. " 

Progress report 

Although interim reports, reactions, and criticism from the par- 
ticipants were obtained throughout the course, an exhaustive, midway, 
evaluation session was held on January 21, 19.63, when the Communi- 
cations Consultant met with the group for this purpose. On several oc- 
casions, the Project Director and Communications Cons\ 2 ltant met with 
the Discussion Leader, alone, to evaluate and revise procedures. In- 
dividual interviews were also conducted with participants and Colorado 
Springs administrative officials. The Project Staff then met on three 
separate occasions to discuss their findings. 

The entire staff met on May 11, 12, and 13, 1963, for further over- 
all evaluation and the preparation of general dra.fts of the revised Study 
Guide and Final Report. The final joint- staff sessions were held on 
June 21, 1963. 

Publicity 

Through both the Public Information Office of the University of 
Colorado and a press release prepared by the Project Staff, noticed of 
the Project have already appeared in Ivory Basement News , The Lin- 
guistic Reporter , Hispania , PMLA , Peals , and The Modern Language 
Journal . At this writing, an abstract is scheduled to appear in IvlL Ab- 
stracts and articles summarizing various aspects of the Project have 
been submitted to appropriate professional journals. Similar announce- 
ments have appeared in several newspapers. (Copies of all available 
releases appear as an appendix to this report, ) 

* 

This publicity has brought numerous requests for descriptions of 
the program and for the materials themselves, from all parts of the 
countiry. 
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INTRODUCTION 

The following evaluation of our procedures is based upon the 
Project’s degree of success in satisfying two related needs in the Colo- 
rado School System for a language education program, originally rec- 
ognized by the State Foreign Language Consultant: (1) to acquaint 
teachers with the main features of the audio-lingual approach; (2) to 
make available a significant part of the applied linguistics and method- 
ology segments of the NDEA summer institutes and related programs 
to teachers otherwise unable to study these materials. 



SELECTION OF LOCATION 

The decision to conduct the pilot course in Colorado Springs was 
based on the following consideratipns: 

1. The presence, within the system, of a thoroughly trained NDEA 
Institute participant who was willing to function as both discussion 
leader and liaison between the participants and the Project Staff. 

2. The fact that few of the other teachers in the system had Institute 
~^or comparable training in the fields of applied linguistics and 

methodology. 

3. The area contained a sufficient number of language teachers in 
several school districts to provide enough voluntary participants. 

4. The relative accessibility from Boulder for purposes of observation 
and guidance., 

5. The existence of a University of Colorado Extension Center for the 
reference shelf, and distribution of films and other materials. 

6. The supposition that the administrative staff of a district the size 
and status of Colorado Springs would agree to cooperate with other 
districts in providing such an in-service opportunity. 

Positive factors 

1. The group assembled was of a workable size (13), representing a 
wide variety of training, interests, and experience. 

2. The Discussion Leader was capable, cooperative, and personally 
interested in the success of the course and of the Project. 

3. A full language laboratory and a comfortable room at a conveniently 
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located high school were provided for our use. 

4. The relatively short distance between Boulder and Colorado Springs 
enabled the Project Staff to be present at frequent intervals and to 
consult easily with the Ihscussion Leader. 

Negative factors 

1. Dissatisfaction with scheduling: Although the length and frequency 
of meetings were in line with most in-service programs, a certain 
amount of dissatisfaction was inevitable. Some of the participants 
felt that the meetings came too close together and left inadequate 
time for careful preparation; others felt that the meetings were too 
far apart and that, therefore, continuity was lost. Of course, an 
in-service training program of any kind suffers, no matter when 

or how often the meetings are scheduled, when it must be in addition 
to a full-time teaching load. 

2. False impressions and expectations: Our original intention was 

for the Project Staff and the local administrators to present the pro- 
gram to the potential participants and then accept a group of volun- 
tary participants. In this case, however, the district administra- 
tors considered it their prerogative to present the program and to 
enlist participants. The result was an inexact presentation of the 
goals and purposes of the pilot program, which gave the impression 
that participation was mandatory. 

3. Narrow range of participants: Because, under the arrangements 
with the Colorado Springs administration, we were unable to open 
the program to teachers in nearby districts, it was difficult to 
build a voluntary group of sufficient size. Thus, the recruitment 
of participants resulted in a mandatory rather than a voluntary 
group. The subsequent attitude of the participants reflected their 
feeling of coercion and their awareness that their administrators 
themselves had mixed feelings about both the necessity and the 
advisability of such a program. 

4. Lack of sufficient advanc;e communication: The first direct contact 
between the participants and the Project Staff was at the initial 
meeting of the pilot course. Had an orientation session with the 
Project Staff taken place before participants were accepted, the 
confusion mentioned in 2, above, probably would not have 
occurred. 
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PARTICIPATION 
Positive factors 

1. The size of the group (13) was satisfactory, since it was large 
enough to present a variety of opinions on each matter discussed 
and to keep the discussion going; yet it was small enough to retain 
an atmosphere of a congenial meeting of friends. 

2. Most participants attended all meetings. Only three were absent 
for a total of more than three times. Only one participant failed to 
hand in all assignments before the end of the pilot course. 

3. At least half the group appeared to react positively and interestedly 
to each session and to the program as a whole. These participants 
also expressed a desire for further training in the course subject 
matter. None considered the training to be negative. 

4. There was a clearly perceptible improvement in the frequency and 
quality of participation by most participants, coupled with a general 
improvement in the quality of preparation of assignments. 

5. The relative ease or difficulty with which the assig^ents were 
prepared provided a clear guide to necessary revisions in the 
materials. 

Negative factors 

1. Active participation in the early meetings was discouraged by the 
involuntary aspect of the recruitment of participants, mentioned 
above. We were unable to rectify this impression in some of the 
participants, although most of them became aware of the profitable 
nature of what was being done and revised their attitudes. 

2. Certain aspects of the makeup of the group created difficulties 
which might have been avoided if an application were required of 
potential participants: 

a. Few of the participants taught Spanish exclusively; in fact, 
most of them taught Spanish for less than half their teaching 
time. 

b. None of the participants had a Spanish major in his college 
training. 

c. One participant was a native speaker of Spanish. 

d. Some of the participants had been to an NDEA Institute and, 
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therefore, found our materials repetitive. 

Thus, these specialized materials for Spanish were being directed 
at once to persons without a specialization in Spanish, causing 
serious embarrassment to those whose Spanish fluency was inade- 
quate to understand the examples, and tc a native speaker and 
NDEA institute trainees to whom, the language and the content were 
familiar. In this way, much that could have been gained by a more 
homogeneous grouping was lost and the success of many discussions 
was limited. 



MATERIALS 

Positive factors 

1. The Study Guide was deemed to have covered the major points of 
interest of the group and was accepted as a stimulating tool. 

2. Three of the four collateral reading textbooks were considered helpful 
and informative. 

3. The reference shelf was found to be helpful, also^ but, because of 
the already considerable amount of time required of the partici 
pants, few were able to make as much use of it as they might have. 

4. The two film series were well-received. The Capretz-Yaie films 
were thought to be the more useful because of their concentration 
on the practical application of the audio -lingual approach in the 
classroom. The MLA-Teaching Film Custodians- ’series were en- 
joyed, but were considered to be excessively repetitive and 
theoretical. 

Negative factors 

1. The only general criticism of the Study Guide was that some of the 
questions accompanying each assignment were repetitive. (These 

were- for the most part, weeded out during the final revision of the 
materials. ) 

2. The films, presented as part of the sessions, required a dispro- 
portionately large amount of meeting time. The Capretz-Yale 
fixms, however, shown in addition to meeting time, were better 
received. 

3. The Meras oook, as collateral reader, was considered to be useful, 
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at best, as a list of addresses for the acquisition of materials; 
otherwise, it seemed to add little *o what could be obtained from 
the Study Guide and the other collateral texts. 



DISCUSSION METHOD 



1. The variety of the backgrounds of the participants insured that 
those answers to the assignments attained by the group discussion 
process were mors extensively based and more seriously con- 
sidered thanv/ere those achieved by single individuals. 

2. The group, on several occasions, expressed its collective satisfac- 
tion with working through the assignments together. They thought 
that this procedure minimized the danger of incorrect answers be- 
cause of misunderstandings and false impressions, and that it gave 
the group the opportunity to hear each participant's views and ex- 
periences, before reaching any conclusions. 

3. Attaining a consensus of opinion frequently enabled the group to 
convince itself of the validity of the approaches presented in the 
Study Guide. Coming from a colleague, this support was readily 
accepted and, in effect, the entire process of "teaching" the ap- 
proach was enhanced and intensified. 

4. In preparing an assignment together, the group quickly discovered 
that the degree of ignorance about the fundamentals of the audio- 
lingual approach was approximately equal among most of the partici 
pants. This created a kind of "we're all in the same boat" feeling 
and minimized the discomfort and discouragement that some of the 
participants experienced in preparing the materials individually. 

The effects of the group experience in comparison with the individ- 
ual preparation were so noticeable that the Discussion Leader 
wrote to the Project Staff: 



I 



Positive factors 



Sample comments: (1) a feeling of learning through 



doing 

(2) more fun 

(3) less boring 

(4) a sense of real accomplishment. 



All of which seems to point out that the group discussion tech- 
nique is effective and the Discussion Leader as teacher is 
superfluous. 
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Negative factors 

1. The largest, single, negative factor was associated with those 
sessions which required individual preparation. The participants 
had little feeling of interaction among themselves. They thought 
that they had been asked to absorb too much new material and to 
demonstrate in their answers a proficient fluency with it, without 
having had a chance to discuss it. Thus, the early meetings usual- 
ly found the group directing its comments and questions to the Dis- 
cussion Leader as a teacher, instead of directing them to one an- 
other or to the group at large. The group continued to view the 
Discussion Leader as a leader /teacher rather than as a stimulator/ 
activator, as desired. Until the group preparation was established 
as a regular pattern, the group continued to look to the Discussion 
Leader for ’’right answers” and for approval, after having made a 
contribution to the discussion. Their orientation remained one of 
wanting to be told, rather than one of trying to find out. 

2. The group needed the opportunity to set up and discuss their own 
goals, and to contribute to the experimental design and conclusions. 
The opportunity provided by the orientation session was insufficient 
for this purpose and, without it, little commitment to or feeling of 
responsibility for the success of the experiment or of the group can 
be expected. Because of this, individuals within the group often 
failed to take the responsibility for equalizing participation: draw- 
ing in the taciturn and curbing the overly vocal. The group re- 
mained insensitive to individual problems and failed on many occa- 
sions to see ho\7 they might help the less forward members to be- 
come effective contributors. 



TESTING 

Positive factors 

1. The testing program provided both the Project Staff and ^ae partici- 
pants with a comparison, however general, of progress made by 
the group in specific areas with that of similar groups in other 
kinds of programs. The advantage of a direct comparison of this 
sort, on the basis of scientifically designed test items, made it 
possible to reach the conclusions presented below, concerning the 
effectiveness of our program. 

2. The use of the MLA tests obviated the necessity of giving a final 
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examination (which otherwise would have been required for credit 
in the University of Colorado and for some indication of what had 
been learned). The advantage thus gained was more significant 
than it might appear, since the group was “test- shy'* and was in- 
clined to think that every test would show them off at their worst 
and have later repercussions in their districts. 

3. For many of the participants, the discovery was welcome that such 
national tests existed for both teachers and students. 

4. After the program was ended, many participants felt, in retrospect, 
that the tests were extremely helpful in pointing out weaknesses in 
their preparation. 

5. Most participants found that the sample test included in the Study 
Guide was an excellent preparation for the MLA series; others 
found the sample test to be a helpful, midpoint, evaluative device. 

A number of participants suggested that it be used as a final exam- 
ination, in place of the MLA tests. 

Negative factors 

1. Some participants were discouraged by the initial administration 
of the MLA tests and felt that they were "expected to do well. " 
Convinced that, if tney did poorly on the MLA tests, they would be 
unequal to the demands of the pilot course, they appeared to give 
up before they started and some never did quite recover. 

2. Some of the "shock" of the initial testing program was caused by 
the fact that the entire test battery is far broader than are the pur- 
poses of the program. Therefore, entire sections, such as written 
Spanish, culture and civilization, and others, were misleading. 

3. The time consumed in administering the MLA tests is dispropor- 
tionate to the scope of the course schedule. 

4. The cost of the entire MLA battery, in viev^ of the need for only 
certain portions of it, is certainly prohibitive to the smaller dis- 
tricts which might make use of the course in the future. 

In brief, the feelings of the group toward the testing program can 

be summarized by the following excerpt from a note to the Staff from 

the Discussion Leader: 

After the testing session, I might as well not have tried to 
do anything with discussion on the film--the atmosphere was 
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leaden and no one said anything. I suppose the boat had 
been rocked a bit too violently, and they were taking their 
resentment out on me. 



COURSE AS ORIGINALLY PROJECTED 

The course was originally projected to provide either instruction 
or practice in language proficiency (oral); techniques of the audio- 
lingual approach; structural and descriptive linguistics; aspects of the 
cultures of the Spanish- speaking peoples; use and preparation of labora- 
tory tapes, films,, and other audio-visual aids: in other words, a gen- 
eral survey of the mater^ls covered in depth in the NDEA Summer In- 
stitute program. As the materials were being prepared, it became 
evident that the time requisite for the participants to absorb the mate- 
rials covering this broad field would be beyond all reasonable demand 
and would prove detrimental to the attitude and progress of the group. 

Course accomplishments . • 

1. Participants were given a course in applied lingmstics which, in 
general, covered the points normally brought out in the Institute 
program, although perhaps not to the same depth. 

2. Audio-visual and language laboratory materials were discussed in 
the Study Guide and in the meetings, and were demonstrated and 
available for inspection a.s part of the reference shelf. 

3. Structural and descriptive linguistics were introduced in both the 
Study Guide and the collateral readings. Consideration of these 
topics was restricted to a discussion and demonstration of techr 
niques useful to the language teacher and an attempt to demonstrate 
how helpful to the language teacher are the results of inquiries in 
these sciences. 

4. A new dimension was added to our experimentation, through depth 
studies in discussion. methods and various group-leadership 
techniques. 

5. An evaluation of these discussion techniques was formulated, in 
order to. recommend the most successful for use in future admin- 
istrations of the course. 

6. The material presented was reinforced by showing both the MLA- 
Teaching Filni Custodians’ and Yale-Capretz film series at 
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appropriate points during the program. The H. L. Smith, Jr. , 
thirteen- reel series was judged to be too specialized in the area of 
general linguistics and too long to fit comfortably and productively 
within the program. 

7. An opportunity was provided for participants to listen to and prac- . 
tice with tapes commercially prepared for use in oral drill, al- 
though a primary focus of this activity was not made. 

Aspects discarded 

1. Because the group was constituted as an independent- study body, 
the idea of an ’’instructor” was contrary to its basic nature. Thus, 
a program to upgrade the participants’ oral fluency in Spanish was 
impossible. The dangers of habituating incorrect reproductions of 
tape models and similar hazards were too great to require partici- 
pants to imitate tape models and then be tested, without ever having 
been able to have their work analyzed and corrected, or without 
benefit of prior discrimination training. Therefore, instead of 
making such activity a central one to our program, we provided 
taped practice materials sufficient for at least two hours per week 
of intensive drill in Spanish pronunciation and diction, but did not 
use the results of this activity as a criterion for grading at the end 
of the course. Even so, the already heavy demand upon the partici- 
pants’ time made the oral drill an unpleasant duty and this attitude, 
in turn, reduced learning efficiency in the activity and not so much 
was gained from it as might otherwise have been expected. 

2. The majority of secondary- school Spanish teachers do not now, and 
probably will not for some time in the future, teach courses beyond 
the intermediate level. For this reason, although an appreciation 
of the culture of the language being studied is an important feature 
of language teaching, and although cultural insights on the part of 
the teacher frequently lead to more effective language teaching, it 
seemed impossible to devote more than one chapter of the Study 
Guide {and associated collateral readings) to this problem within 
the scope of the course as projected. Again, v/e adhered to a 
policy of centering the course around applied linguistics and the 
audio-lingual approach, mentioning such related subjects as culture 
and civilization in the context of their position in the audio -lingual 
approach to language teaching. Because, as mentioned above, 

this proportion seemed to represent the teaching activities of 
most of the participants (actual and potential), we felt that it was 
justified. 
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BUDGET AND PERSONNEL 

Not all budgetary needs can possibly be foreseen in such experi- 
mental work, and, as a result, some segments of the budget were in- 
sufficient to the needs of the Project and some represented an over- 
generous allotment. 



Insufficiencies 

1. Clerical assistance. The amount allocated to the Correspondence - 
Study Office at the University of Colorado was hoped to be sufficient 
to meet the expenses of completing the clerical obligations. As the 
Project developed, it became clear that a full-time clerical assist- 
ant and editor were needed throughout the preparation of the Study 
Guide and at the end of the Project for the final revision of the Study 
Guide and the preparation of the Final Report. 

2. Released time for participants. As is provided in the NDEA Sum- 
mer Institute program, some type of compensation is necessary 
for participants. It appears obvious, now, that some arrangement 
for compensated, released time sho\ild be made for this type of in- 
service program. Whether this should be a subsidy, as is the case 
in the NDEA Summer Institutes, or should be a financial responsi- 
bility assumed by the sponsoring district, participants cannot be 
expected to devote the time and thought required for mastery of the 
material presented in the course and the extracurricular responsi- 
bilities inevitably entailed, in addition to full-time teaching. 

Qve r budgeting 

1. The testing program, in view of our comments under TESTING, 
above, and in the following section of the Report, was overbudgeted. 
We feel now, as explained in more detail below, that the only sec- 
tions of the MLA tests representative of the materials covered in 
depth are those concerning applied linguistics, professional prepa- 
ration, and spoken Spanish. Even this last, in view of our com- 
ments under COURSE AS ORIGINALLY PROJECTED, above, 
might be considered optional. In groups of twelve or more partici- 
pants, the savings effected by this reduction in testing would be 
considerable. 

2. Because we did not show the H. L. Smith, Jr. , linguistics films, 
all the rental and projection fees allotted for films were not ex- 
pended for that purpose. 
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Fortunately, the balance was almost exact, between funds saved 
from overbudgeted segments of the Project and funds required to make 
up deficits in other segments, and the Project was completed within the 

specified budget. 



EFFECTS OF COURSE 



Positive factors 

1. The participants considered the material presented both interesting 
and useful. The testing results gave evidence that most partici- 
pants learned much. 

2. Members of both the Colorado Springs administration and the 
Project Staff observed many instances of immediate revisions in 
the participants* classroom techniques effected by application of 
principles learned in the course. 

3. A significant improvement was, shown in the comparison of pretest 
and post-test data of the MLA tests. 

4. The materials package produced through the Project is potentially 
useful throughout the nation. 

5. The materials, in first draft, were presented to the Foreign 
Language Supervisors* Conference in Washington, D. C. , in the 
spring of 1963, where they were well-received. Subsequently, re- 
quests for the materials have been received from all parts of the 
country. 

6. The course itself awakened, in the participants and the general 
public, new interest in larger training programs, such as the 
NDEA Institutes and others. 

Negative factors 

1. Because the course was experimental in nature, time proportions, 
the extent of the testing program, course procedures, and other 
factors were altered several times throughout the experiment. 
Although the participants were intellectually aware of the experi- 
mental nature of the course and, consequently, of the need for 
these procedural changes, the changes themselves seemed, 
nevertheless, to create a “guinea pig'* feeling and to undermine 
to some extent the participants* faith in the course as a project 
designed for their benefit, as opposed to one produced only for 
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experimental results. 

2. At the end of the experiment, most participants, however satisfied 
they were with the results, felt that the demands of the course 
were impossible to fulfill to their satisfaction, in addition to full- 
time teaching responsibilities. 




to 
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Part lU RECOMMENDATIONS FOR OE - 2 - 14 - 035 

FUTTTRE PROJECT ADMINISTRATION 

PREPARATION OF MATERIALS AND ADVANCE ORCJANIZATION : 

(In this discussion, "Project Staff" refers to those persons in charge of 
administering the program. ) 

• • o 

Advance organization 

The Project Staff, after thorough discussion, should prepare a 
carefully formulated list of the goals of the program and enumerate 
them unmistakably. This will provide the basis for unequivocal dis- 
cussion with district leaders, potential participants, etc. Such a pro- 
cedure will most certainly eliminate the possibility of misunderstand- 
ings and will provide a ready reference for questions about setting up 
the program as they arise. 

Plan of operation 

A complete plan of operation, adapted to the needs of the specific 
group and location, in accordance with the principles suggested on 
pages 215ff of the Study Guide, should be worked out by the Project 
Staff and then presented by them to the district leaders, in an attempt 
to achieve complete accord. Participants should be given copies of the 
plan, or at least an abstract of it, so that, from the beginning, they may 
be fully apprised of the direction of the course and the expectations as 
to their progress. 

Staff responsibilities 

We found that the members of the Project Staff, in order to accom- 
plish all that needed to be done, had to assume more responsibilities 
than those originally outlined. The Project Director was responsible 
for the testing program, general Project coordination, authorship of 
the Study Guide, evaluation of participants' progress, annotation of 
assignments, authorship of the Final Report, etc. The Communications 
Consultant was responsible for authorship of the group- study section of 
the Study Guide, acted as progress evaluator, general liaison between 
the Discussion Leader and the Project Director, etc. The same might 
be said for other members of the staff, all of whom accepted responsi- 
bilities beyond those originally specified. We recommend, then, that 
future staffs be clearly apprised of the specific responsibilities of each 
member, that pains be taken to insure sufficient staff (we were under- 
staffed), that a schedule of deadlines be prepared when certain phases 
of preparation and carrying out of the program are to be completed, and 
that specific responsibility for meeting these deadlines be equitably 
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assigned, in ^4V2-Xice, among the various staff members. We. recpm- 
mend the planning of a sufficient number of staff meetings to achieve 
the goals suggested in the three paragraphs above* well, in advance of 
the inception date of the course. . ; . 



Preparation of material 



The Study Guide and all explanatory material should be in the par- 
ticipants- hands well in advance of the first group meeting. Since that 
first meeting tends to bring out questions not asked at a mors general 
orientation meeting, especially if the first meeting is also the orienta- 
tion meeting, it is advantageous for the participants to examine the 
course materials and to ask all pertinent questions before beginning 
the hard.work of preparing the assignments. 



Location 







It is difficult to predict with whom the suggesti6n.„to pi*es,ent such 
a course will originate.. Sometimes, district leaders or state cons\iit- 
ants will suggest it. Sometimes, a group. of interested teachers vvill 
request an in-service program. Sometimes, a University Extenjsio^ 
Division will want to bffet it. In any case, a steering committee 
(Project Staff)/ shomd be set, u first, to determine the advisability of 

establishing such a program as originally suggested. The Staff should 
first take into consideration the location. The Staff shoiild make sure 
that the course itself ^iOt become constituted as the private property of 
a single school district or group. It should establish the idea that the 
course. is being offered in a specific district, rather than that the dis- 
trict is Offering a course for its personnel. 



Staff or local re spOnsibilitie s > / 

It should be made clear that there be an equitable division of effort 
and responsibility between the Staff and the district officears in the prep* 
aration and undertaking of the course.. The district should assume, 
first, the responsibility of providing a suitable location, including the 
facilities listed under SELECTION OF LOCATION, in Part II, above. 
This eHminates all possibility of- resentment against the arbitrary 
selection of location by an "outside”, committee. It shotild be ,the 
district^ responsibility to distribute the general announcement about 
the course and, subsequently, the application blanks, all previously 
prepared by the Staff, There are three reasons for this allocation of , 
responsibility. First, it implies the general support of the local ad- 
ministration. Second, it guarantees a wider distribution- -especially 
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in outlying schools--than could be achieved economically through direct 
mail from the home institutions of the Staff. Fina.lly, it Stresses the 
’’local” nature of the course as a program offered to teachers in a par- 
ticular district for the betterment of themselves and the system in 
which they work. The district, for similar reasons, should assist 
with the screening of applicants so that the group may benefit from the 
inclusion of some teachers who, for one or another reason, might 
otherwise have been overlooked. Final decisions about selection of 
applicants must rest with the Staff, however, so that no charges of 
coercion on the part of the local administration will be possible. The 
district should also make efforts to provide released time for the par- 
ticipants in the program. Aside from the very practical advantage of 
allowing more tixhe to be devoted to the preparation of the materials 
themselves, released time also indicates the local administration’s 
firm belief in the importance of the course. We found, during the esfc- 
perimental atoinistration of the course, that great resentments de- 
veloped from the simple factor of intellectual exhaustion, since the. . 
participants had already taught a full day and, in many cases, had 
taken care of family commitments before returning to school in the 
evening for a session of the course. Often, they were unable to d«> 
their best in the course and, being aware of that fact, were quick to 
feel discouraged and, then, resentful of the imposition on their time. 

ADMINISTRATION OF PILOT COURSE 

Orientation meeting ; ^ 

A full-day orientation meeting before the course begins would be 
of inestimable value in getting the program off on the right foot. .This 
might be accomplished on a Saturday and, if possible, might even in- 
clude an informal luncheon paid for by the local administration. No 
matter how well-written the announcement and application blanks may 
be, there will be many unanswered questions. Also, a significant 
percentage of the group will still not be completely clear about the 
objectives of the course and how these are to be achieved, even though 
they have filled out an application and have been accepted as partici- 
pants. Therefore, implicit in this prientation session should be the 
idea that, if anyone has second thoughts about the program, now is the 
time to withdraw, without any prejudice whatsoever. The orientation 
meeting should be conducted as an open forum, with the Staff and 
members of the local administration present to answer questions and , 
to explain the program. 
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Again, it is impossible to exaggerate the importance of establish- 
ing the following concepts at the outset: 

1. Why the course is being offered and what the district and course 
Staff expect to accomplish. 

2. The role of the participant in the program and what is expected of 
him. 

3. The course is a meeting of colleagues and, hopefully, friends, 
interested in the same goals for the purpose of mutual improve- 
ment and of the betterment of the entire profession. 

4. How participants can help one another and how they can make the 
course more meaningful by sharing their experiences. 

5. The whole, proven concept of roup discussion as an effective- - 
perhaps even most effective- -xearning method. 

6. Implicit problems of group leadership in general and of shared 
leadership in particular. 

7. The specific kind of group -discussion technique to be used (cf. 

The Modern Teaching of Spanish, pages 215-218). 

8. Course r echanics, especially the question of evaluation. It must 
be made clear how the assignments are to be evaluated and how 
final grades, if any, are to be assigned. The issue of grading^ 
cannot be avoided in cases in which credit is granted to partici- 
pants by a university or other institution. The evaluator should 
assign number or hotter grades on the basis of points earned. 

In group preparation of assignments, the individual's course 
grade must be based either on a final examination or, and this is 
more trtily representative of progress, upon the degree of im- 
provement demonstrated in a compar^on of the pretesting with 
the post-testing program (cf. Testing procedure, below). Grades, 
however, are not a necessary part of the program itself and, 
often, a freer atmosphere will exist if grades are not involved. 
When the course is offered for credit, however, grades are re- 
quired and must be given. The question having been decided . 
earlier in consultation between the district administration and 
the Staff, the participants should be told frankly who will look at 
the results of the course and for what purpose. The participants 
in the experimental course were unsure of the possible effect that 
a poor performance might have on such matters as tenure, merit 
increases, teacher -administrator relations, and the like. Although 
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the assignment of grades is optional, dep€ idihg upon the credit to 
5 ^"^^ be received by participants, some ’*pro6f“ of the satisfactory com- 
pletion of the course should be automatically provided. Our rec- 
ommendation is that, regardless of whether or not. grades are 
given, a certificate of participation should be issued to each 
participant. Should the participant require a transcript of his 
credit, he should request such a credential from the university 
which, sponsored the specific program in which he participated. 

Testing procedure 

It became clear, as we mentioned above, that certain areas rep- 
resented in the MIA Proficiency Tests did rot correspond to areas of 
control set up as objectives of the course. Therefore, we recommend 
administering only the following sections of the MLA tests as a part 
of the course: 

1. Professional preparation 

2. Applied linguistics 

3. Speaking Spanish, 

The third category, for that matter, might well be considered 
optional, since the materials provided for oral drill are de-emphasized 
so as to avoid crowding too' closely the aspects of applied linguistics 
s.nd professional preparation. 

The length of tirne required to administer the entire battery of , 
MLA tests is simply not available in the. program as recommended 
in this report. Under ideal testing, conditions (as reflected in the Final 
Report to the li. S. Office of Education from the Sinnmer Institute at 
the Uniyersity of Colorado, 1963), seven hours are required for the 
administration of the battery, with some intervals required for rest. 

It can easily he seen, then, thai perhaps four, entire, two-hour 
sessions would be required for testing alone, a block of time which 
we feel is not justifiable in the one- semester format for the course 
as we have, described it. 

From the point of view of participants' attitudes, the extensive 
testing program (all phases of the MLA series) given at the beginning 
of the Pilot course served to discourage the participants by demon- 
strating ^'how little they knew" and by creatinj^ a "guinea pig" atmos- 
phere in which existed a psychological fear that local administrators 
might see the results of these tests and that a poor showing might re- 
sult in some kind of "review" of the files. No amount of persuasion 
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about the “purely experimental and confidential" nature of the testing 
program served to alleviate the mistrust. 

Use of films 

The place of the film in the Pilot coarse was subject to constant 
review. We feel that the real purpose ox the film in a course of this 
type is twofold: to clarify in a graphic fashion seme of the “ground" 
principles of the course material and to demonstrate some of these 
principles in action. To this end, two sets of films were chosen: 
first, the MLA- Teaching Film Custodians’ 5- reel series and, second, 
the Capretz-Yale Spanish demonstration class films. The first series 
were shown at the beginning of the program, with corresponding dis- 
cussion questions in the Study Guide. This was a valuable procedure 
because the filn s presented ideas which v/ere immediately reinforced 
in the Study Guide and in discussion, thus providing a common ground 
for understanding from the outset. Criticism of the films centered 
about their "elementary" approach, but most parUcipants agreed that 
the level was appropriate to the purpose and to their own point of a- 
chievement. The Capretz-Yale films were shown at the conclusion of 
the Project in order to demonstrate the application of the techniques 
and theories we discussed in the actual classroom situation. The 
effect was excellent, in that all the "parts" of the course seemed to 
fall together in this symbolization. The question remains, however, 
if the effect might not have been greater had the films been shown 
approximately three -fourths of the way through the course, when time 
woiild still have been available for discussion of pbints brought out in 
the films. 

The showing of the Capretz-Yale films was opened to the entire 
district as a gesture of the district-wide intentions of the Project. 

This appeared to have left an excellent feeling of goodwill and we 
recommend this procedure in future administrations of the course. 

We woxild discourage the use of the Smith 13- reel series because 
of the length of time required, although the district might be encouraged 
to show them after the course was completed, assuming that enough in- 
terest in linguistics had been generated by the course itself. We 
strongly recommend the showing of one or two of the dialogue films to 
accompany Modern Spanish , since the technique of filmed dialogues is 
relatively new in ttie secondary field. The cultural authenticity of the 
dialogues, a major feature of the scientifically planned, audio-lingual 
dialogue, is also demonstrated in this way. Again, the value of the 
film will be enhanced by a discussion period after it. For this purpose, 
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an extra two-hour session should be inserted in the course schedule. 
Other films (including the Cadoux series) might best be shown as sup- 
plements, rather than taking course time. 
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Group organization 
1. Leadership 

There are three possibilities with regard to the type of leadership 

that an independent, group- study program might employ: 

a. Shared leadership 

This is most feasible in smaller groups (approximately 
eleven participant.? or fewer) and has the advantage of making 
everyone responsible for the group’s progress, rather than 
setting one individual apart and assigning the responsibility 
to him. Thus, each participant gains a feeling of personal 
commitment to the group, rather than simply writing up some 
assignments and contributing perfunctorily to discussions. 

The very absence of an "authority” figure is interpreted a- 
mong mature groups as a testimony of faith in their ability to 
work productively together. . The principal disadvantage is the 
requirement that, for optimum efficiency, each participant 
must be fully aware of what is expected of him at every step. 
Such a clarification can be only partially successful if limited 
to printed instructions, no matter how detailed and exact, 
either in the Study Guide or on a separate flyer. A question- 
and-answer session is apparently an absolute prerequisite. 
This is perhaps best accomplishec at the orientation meeting 
in which discussion may be anticipated by a printed discussion 
outline some seven- to-4en days before the meeting. Then, a 
brief "demonstration session" might be held, in which Staff 
members and participants wovild show how discussion is mo- 
tivated, stimulated, and brought to a fruitful conclusion. 

b. Shared leadership with a revolving moderator 

Again, because no "outside" authority figure is established as 
moderator, the group benefits from the principle of type a, 
above, yet differs from it in the sense that a single individual 
(a different person at each session, either elected by the 
group or chosen on the basis of a preestablished order) as- 
sumes the principal responsibility for guidance and "gate- 
keeping. " The clear advantage is the gain in efficiency and 
economy of operation, getting the job done in less time. 
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Groups of twelve or more will find it almost mandatory to 
have a moderator, simply to insure that everyone who wishes 
have a chance to contribute, and to curb the overly vocal 
while drawing out the reticent. It must be noted, too, that 
the revolving nature of the moderatorship means that almost 
everyone will be ”on the spot” at least once and will reflect 
the experience in his own, improved participation, thereafter. 

c. Permanent leader 

Although we experimented with types a and b, the experimen- 
tal nature of the Pilot course made it necessary for us to rely 
for at least 75% of the time on the presence of a permanent 
discussion leader, essentially for the purpose of reporting 
back to the Staff concerning the under standability of the ma- 
terial, reactions of the group, particular joints of confusion 
or difficxilty in the preparation of assignments, and the like. 

On the basis of the Pilot course,, however, we recommend 
that this permanent-leader type be considered third and least 
preferable among the forms discussed here. 

If a group selects this, third alternative, however, it would be 
advisable to insure that the leader's qualifications rest more 
on his experience with and skill in effective discussion- 
leading than on substantive superiority. The "image" of the 
permanent discussion leader is of great importance. If his 
appointment has been made because he is more knowledgeable 
or has more experience in the areas being taught, it will be 
difficult— if not impossible— for him to rid himself of the 
"teacher" role and to help the group become self-sufficient 
enough to evolve its own answers as recomniended above. 

2. Recorder 

The Pilot course proved the usefulness of the recorder. Electing 
one member of the group to note the principal points of the day's 
session freed the other participants to devote their entire attention 
to the discussion. Allowing a ten-minute period at the end of the 
session gives the group an opportunity to hear a resume of the 
discussion and to amend it in any way it sees fit. This procedure 
ensures that the recorder's notes represent group consensus, 
rather than merely one person's version. We strongly recommend 
the continuation of this practice in future administrations of the 
course. It would be wise for the group to decide on a schedule of 
recording duties at the first session, so that no question might 
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3. 



arise as to whose responsibility it is to record the events on a 
given day. Another method of providing a record of the proceed- 
ings has been suggested by two participants: tape-record the en- 
tire session. The advantage of a complete record of the transpir- 
ings appears to us to be outweighed by the cumbersome necessity 
of extracting the essence from it and by the time required. to hear 
over again the entire two-hour session. Despite a possible 
pedagogical value inherent in rehearing the session, most 
teachers simply do not ha^e the time to double the hour require- 
ment involved in this program. Moreover, the mere presence of 

the recording machine might influence or inhibit the discussion. 

* > *# 

Once the recorder has read the notes aloud and revised them as 
instructed by the group, he should have them typed and reproduced 
either (a) at his own institution, (b) at the offices of the admin- 
istering institution- -as in the case of a University Extension 
Division, or ^c) at the offices of the supervising instructor. 

These reproductions should then be distributed to the other par- 
ticipants at the earliest possible moment. If possible, arrange- 
ments should be made to get these notes to the participants by 
maU as far in advance of the following session as possible. In 
addition to providing each participant with a realistic abstract of 
proceedings, these notes serve as a valuable reaffirmation of the 
group's ac ^omplishments up to that time and an excellent starting 
point for the following session. 



In the case of the group preparation of assignments, which we 
heartily recommend (cf. Part I, PILOT COURSE BEGINS, Class 
procedures) , the recorder notes the answers, rechecks the text 
at the end of the session, and types and duplicates them as sug- 
gested above. The annotated version, returned to the recorder by 
the supervising instructor, should be made available to the par- 
ticipants for inclusion in their notes and to serve as a further 
stimulus for the discussion at the following meeting. 

Secretary 



It is of great importance that an individual be elected or appointed 
to serve as permanent liaison between the Project Staff and the 
participants. The Pilot Project made use of the permanent Dis- 
cussion Leader for this purpose. Where shared leadership is 
used, a liaison officer (called here "secretary") is needed: to for- 
ward materials to the instructor; to receive materials from the 
instructor and the administering institution; and to coordinate, 
with the Staff, details of meeting place, reference shelf, etc. 
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The importance of this function is intensified even more by the use 
of the MjLA Proficiency Tests, the administration of which would 
be a part of the secretary's role. 

Staff requirements . 

Inherent in the design of the materials prepared for the course is 
the possibility that it may be operated without any direct connection 
with a supervising or administering institution. It is not likely, how- 
ever, that such independent operation will be elected, in most in- 
stances. The desirability of college credit, annotated assignments, 
resumptive examinations, and the like is apparently strong enough to 
justify the belief that, in most cases, the course will be administered 
through a University Extension Division or some analogous body. >-'^he 
following remarks and recommendations for Staff are based upon that 
belief. 



1. Extension officer. An appropriate officer of the Extension Divi- 
sion should be a member of the Project Staff. His duties include 
coordination with local district authorities, decisions and opera- 
tions relating to registration for college credit, necessary au- 
thorizations for Staff travel, duplicating and secretarial services, 
setting up reference materials in nearby Extension Centers, and 
the like. In the case of the Pilot Project, the Director of Corre- 
spondence Study in the Extension Division at the University of 
Colorado served in this capacity. We recommend that an officer 
of comparable stature be included in future Staffs. 



Instructor. A qualified instructor in language-teaching methodol- 
ogy and applied linguistics should be engaged to annotate the 
assignments. It is urgent that the instructor be more than simply 
a teacher of Spanish and that his acquaintance with language -teach- 
ing methodology be more than casual. His qualifications should 
include at least one advanced degree with concentration on linguis- 
tics or language teaching, research in the field as evidenced through 
publication, and some experience in working with secondary- school 
teachers of Spanish, perhaps in an NDEA Summer Institute. 

Communications specialist. The success of the course depends 
largely upon the effective organization of the group for optimum 
use of the discussion technique as a learning device. A person 
trained in speech and communication theory should be a member 
of the Staff. The function of the communications specialist would 
be to assist the group in deciding upon and setting up the pattern 
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for the specific discussion technique to be used; to aid in the ad- 
ministration of MLA Proficiency Tests, if desired; and to offer 
periodic advice and recommend procedures to the group throughout 
the course. The communications specialist should conduct the 
orientation meeting and should arrange to appear, imannounced, 
at one or more meetings to observe, firsthand, group activities 
and progress. 

4. A stenographic assistant, preferably located in the offices of the 
sponsoring or administrating body. The assistant would aid the 
Extension officer, instructor, and communications specialist , by 
typing, duplicating, and distributing teaching materials; by order- 
ing tests, sample texts, textbooks; and by corresponding with par- 
ticipants, local districts, etc. 



5. 



State Foreign Language Supervisor. Provisions should also be 
made for preliminary consultation with the State Foreign Language 
Supervisor or Consultant whose assistance may well be invaluable 
for those course programs utilizing liaison between a local district 
and a University Extension Division. 



It is understood, of course, that the Staff mentioned in this section 
would be available for consultation at any time, via telephone or 
letter, and, by appointment, for a personal visit, if requested by 
the group. 



Timing and scheduling 

Every effort should be made to insure that the meetings required 
to complete the course fall within the period of one school semester, 
taking into careful account, not only school holidays, but also periods 
of especially heavy demands upon the teacher participants. The figure 
of two hours per meeting should not be exceeded. A five- or ten- 
minute break between the two-hour segments is to be encouraged, as 
the attention span of the participants may be strained by a two-hour 
period of unbroken concentration. 



BUDGET 



Salaries 



Budgetary insufficiencies were noted insofar as the work of the 
1962-63 experimental Project Staff was concerned. For future admin* 
istrations of this course, as preparGid, however, salaries must be 
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computed on another basis. 

1. Instructor. The instructor should be pciid the equivalent of the 
salary for a three-hour classroom course, for annotating the 
assignments and "administering" the course. 

2. Extension officer. The extension officer, where possible, should 
also be compensated in a similar fashion. 

3. Communications specialist. The communications specialist should 
receive hourly compensation, based upon his academic salary, or 
should be paid the equivalent of the salary for a three-hour class- 
room course. 

4. Group discussion leader. The group discussion leader, if this 
discussion method is chosen, should receive no remuneration, un- 
less a report, final or periodic, is required by the Project admin- 
istration for one or another experimental purpose. In such pases, 
$600 should be allotted for the purpose. 

5. Participants. We heartily recommend that the already overloaded 
teacher be allowed released time for participating in this in- 
service program. We propose that: (a) the district should pay 
for this released time, or (b) if the district is unable to pay, the 
course budget should provide for paying to the district the addi- 
tional costs of such released time. 

Teaching materials 

1. Reference shelf. Allocations for the reference shelf and other 
teaching materials would vary with the specific course. The refer- 
ence shelf is of considerable importance and should be planned for 
in the budget. In some cases, the materials can be borrowed from 
nearby university libraries. This problem is easily solved if the 
course is administered by a University Extension Division through 
whose centers library materials may be acquired and distributed. 

2. Tapes. Since the improvement of the participants’ linguistic abil- 
ities in Spanish was discarded as a central purpose of the Pilot 
course, the decision was made to use commercially prepared 
tapes, which we dubbed, for oral practice. By far the most 
significant function that the tape can perform in the course, from 
the point of view of applied linguistics and methodology, is to pro- 
vide demonstrations of the techniques and materials suggested in 
the Study Guide, rather than as a teaching tool in itself. 
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To a certain extent, this demonstration need was filled by the film 
program. Samples of the dialogue films from Modern Spanish 
were also helpful in this sense. Still, tapes illustrating proto- 
types of phonetic and syntactic drills of the type and in the order 
discussed in the Study Guide aid the participant immeasurably in 
following and understanding the corresponding discussion. Funds 
should be set aside for the preparation of such tapes, a task usual- 
ly accomplished by enlisting the cooperation of experienced college 
teachers of Spanish in taping their actual class sessions when such 
drills are planned. 



MATERIALS AND TEXTBOOKS 

From the viewpoint of our evaluative remarks (tf. Part II, 
PARTICIPATION), the choice of collateral textbooks was wise. 

Modern Spanish (as would any other scientifically designed audio- 
lingual textbook) served to illustrate the practical application of the 
ideas discussed in the course. The books by Hall, and Pplitzer and 
Staubach were also useful in providing a background in depth concern- 
ing the contributions of linguistic science to the teaching of modern 
foreign languages, especially Spanish. We, therefore, recommend 
that these textbooks be used again, as collateral reading in the course. 
The M^ras book, however, was considered to have added little to the 
information available in the other collateral textbooks and the Study 
Guide. In view of the uniformly negative response to M^ras by the 
participants in the Pilot course, we recommend that it be dropped as 
a collateral textbook and not replaced. 
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RECOMMENDATION LETTER 

University of Colorado 
Boulder, Colorado 

Extension Division September 10, 1962 

Dear Colleague; 

As a part of a course in applied linguistics for high- school Spanish 
language teaching being developed for the U. S. Office of Education, I 
am preparing a “minimum" list of essential books and article reprints 
to form part of the basic reference library for teachers in secondary 
schools with an audio-lingual foreign language program. 

I should greatly appreciate your help by indicating below those 
materials which you consider of exceptional value for this purpose and 
returning this sheet to me. 

Thank you very much. 



Sincerely, 



David M. Feldman, 
Project Director 



Recommendations: 

I. Theoretical foundations (general linguistics, etc. ) 



II. Applied linguistics 



III. Methodology (classroom and laboratory techniques) 



IV. Spanish structure 
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RECORDER'S NOTES 



Introductory Remarks ; 

In the following assignment, participants v/ere asked to choose a 
traditional textbook currently in use somewhere in their district. Using 
techniques and principles discussed in Assignments I through IX, they 
were to adapt a unit from the chosen textbook for use in the audi >- 
lingual approach. After having been cautioned that it is always prefer- 
able to use scientifically designed materials than to risk error and im- 
perfection in self-adapted materials, the participants were permitted 
to prepare the assignment. 

The practical value of the exercise is threefold: 

1. The participants became aware of both the very carefxxlly planned 
inner structures of, and the difficulties inherent in, the preparation 
of such materials. 

2. They learned to work together as a "departmental" team to pool 
resources (native speakers, teachers with superior control of 
structure, etc. ) for the betterment of instruction. 

3. They became aware, as never before, of the superiority of mate- 
rials professionally prepared for audio-lingual approaches. 



Recorder's Notes : Spanish 495-2 

March 18, 1963 

Roll was taken and Miss Jolly distributed Minimal pair cards and 
the recorder's notes for the February 11 and March 11 sessions. It was 
announced that at our next meeting we should read Assignment X. The 
group adapted a chapter from a traditional textbook for audio -lingual 
use, the outline of which follows. 

Assignment IX. Adapting a traditional textbook. El Camino Real I 
(third edition). Chapter XIX, pp. 292-303. 

Content of chapter: 

(1) verbs: traer , caer, ofr , seguir (present tense); (2) comparison 
of regular and irregular adjectives 

(3) expressions used in comparisons 
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(4) expressions with tener 

(5) important vocabulary items: 

loteria, ntimero, pedazo, por, premio, seguir, 
afortunado, billete, botella, buscar, camibn, contar, 
decidir, escoger, ganar, gordo, hallar. 



Dialogue li 
Alfredo: 
Pane ho: 



Alfredo: 

Pancho: 

Alfredo: 

Pancho: 

Alfredo: 

Pancho: 

Alfredo: 



Ya escogi mi billete de loteria. Es el numero 23,072. 

Un nbmero tan feo como el 23, 072 nunca puede ganar el 
premio gordo. Tenemos que buscar el nbmero 9077 que 
vf en mi sueho. Decidf que es el mejor nbmero de la 
loterfa. 

Tienes razdn. Ese es mis bonito que mi ndmero. Sin 
duda es muy difibil hallar ese ndmero y no tengo tanto 
dinero como td. 

Si quferes comprar unos p,idazos de ese billete. yo te 
doy la mitad del premio que vamos a ganar. 

Ya caigo. No tienes bastante dinero. Pero tengo mucha 
hambre y sed. Vamos a comprar unos tacos y botellas 
de Naranja Crush. 

Y entonces seguimos hasta el mercado por camion porque 
tengo frfo. 

Oye, Pancho. Aqui esta un vendedor con el numero 9077. 

A1 contar mi dinero, hallo qne solo me quedan cuarenta 
centavos, y por eso no podemos comprar ni siquiera un 
pedazo. 

Tal vez el ndmero 9077 es el ndmero mis afortunado. 

Tal vez el billete que traigo es mis afortunado. Vamos 
a ver. 



STRUCTURAL PATTERNS FOR DIALOGUE I 

A. Based on traer , caer , oir , seguir 

1. el billete que yo traigo 

ella .... 

tu 

nosotros 

ellos 

ustedes 

el 

mis amigos 
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yo caigo 
Alfredo . 



✓ 

tu 



Pancho y yo 
ellos 
nosotros 
Pancho y Alfredo 
usted 



3. Pancho te oye 



yo 
Maria 
tu 



4. 



Pancho y yo 
ellos 

Maria y Pancho 
usted 

Entonc^s (nosotros) seguimos por camiOn. 
Alfredo y yo 
los chicos 
usted 
Pancho 
yo 

Alfredo y Pancho 
ustedes 



I 



B. 



Comparison of adjectives 

1 . 



a 






Pablo es 
Pablo es m£s 
Pablo es el m^s 

Pablo es 
Pablo es m£s 
Pablo es el m^s 



Pablo es 
Pablo es m£s 
Pablo es el m£s 



2 . 



Su casa es 
Su casa es m^s 
Su casa es la m^s 
Su casa es 
Su casa es m^s 
Su casa es la m^s 



) 


)... 

) 


• • • afortunado 




) 


)... 

) 

) 


. • • rico 




)... 


• . . gordo 




) 


* . 

grande 








A 




pequefia 
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casa es 




Su casa es m£s 


bonita 


Su casa es la m£s 




Su casa es 




Su casa es m£s 


fea 


Su casa es la m£s 




Su casa es 




Su casa es ni£s 


nueva 


Su casa es la m£s 





3. 

Es estudiante 

Los estudiante 8 

4. 

Eres 
Pablo es 

Pancho y Alfredo son 

5. 

Un ndmero tan 



una casa 
una ciudad 
una boterfa 
una botella 
una fcunilia 



No tengo 



No tengo 



es afortunado 
es m^s afortunado 
es el mils afortunado 
son afortunados 
son m^s afortunados 
son los zn£s aforttmados 



mUs rico 
m£s afortunado 
m£s gordo 
m£s afortunado 
m£s rico 
m£s gordo 
m£s ricos 
m£s afortunados 
m£s gordo s 

feo 

bonito 

afortunado 

grande 

pequefio 



que yo 
que yo 
que yo 

como el tuyo 



tan grande como la tuya 



tanto dinero 
tanto tiempo 

tanta suerte como tu 

tanta familia 

tanto s billetes 

tanto s pedazos como td 

tantas camisas 
tantas botellas 
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Tengo 



Tengo 



el niomero 
el pedazo 
el billete 
los ndmeros 
lo8 pedazo s 
los billet es 



m£s afortunado de la loterfa 



m£s afortunado 8 de la loterfa 



Dialogue II (Expressions with tener) ; 

Marfa: Carmen, vamos al centre. Tengo que comprar un regalito. 

Carmen: ]^ueno. ^JPara qui^n.vas a comprar el regalito? 

Marfa: Pues, hoy es el cumpleahos de mi hermano. El tiene solo 

ocho anos. 

Carmen: Tengo mucho calor. 

Marfa: Bueno. Tengo sed. Vamos a tomar un refresco antes de 

visitar las tiendas. 

Carmen: Tambi^n tengo sed y hambre. i Porque no tenemos unos tacos? 

Marfa: {Cdmo no! Pero ten cuidado o vas a tener dolor de estdmago. 

Carmen: Tienes razdn. jAy, qud buenos estdn! 

Marfa: ^ Quleres una paleta, Marfa? Gracias. i Sabes que ahora 

tengo frfo ? 

Carmen: Yo tambidn, pero tenemos que ir al centra para comprar el 

regalito. 

Marfa: Pronto va a ser hora de dormir la siesta. Tengo mucho suefio. 

Vamos a tener prisa. 



STRUCTURAL PATTERNS FOR DIALOGUE II 

1. td tienes razdn 

41 

Carmen 

yo 

las muchachas 

Noso^ros 

ell» 

ella 
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tengo mucho sed 

hambre 

frfo 

sueSo 

calor 

cuidado 

prisa 

gusto 

Carmen tiene dolor de estdmago. 

dientes. 

cabeza. 

pies. 

£1 hermano tiene ocho aiios. 

Yo 

td 

Nosotros 
Marla- y yo 
ellos 
ustedes 
ella 

Tenemos que buscar un regalito. 

Marla 

Elios 

Yo 

Td 

Ustedes 
Marla y yo 



APPENDIX III 



PROJECT PUBLICITY 



OE - 2 - 14 - 035 



On September 24, 1962, the University of Colorado News Ser- 
vice prepared and distributed a press release, the text of which follows: 



BOULDER, COLO. Thanks to a pilot project just beginning at 

the University of Colorado, high school foreign language teachers may 
get training in their own communities to increase their speaking and 
teaching proficiency. 

The U. S. Office of Education has made an $8, 874 grant to CU for 
experimental preparation of study material and techniques for foreign 
language teacher reeducation without on- campus work. 

By means of a combination of local group study pd individual labo- 
ratory and correspondence work, known as **in- service training, 
teachers will be able to improve their speaking fluency and learn the 
newer methods of teaching languages. 

Dr. David M. Feldman, new assistant professor of Spanish at CU, 
is director of the modern foreign language project. He is developing a 
study guide and related tape recordings for the in-service training, and 
will provide periodic expe*rt guidance for the trial group in the project. 

According to Feldman, many high school .language teachers are un- 
acquainted with modern electronic teaching aids for language study, or 
need more training in the audio- lingual approach- -learning a language 
by oral practice and usage, including tape recordings, for some time 
before referring to the written language. Also, many teachers are re- 
quired to teach foreign languages with very little specific preparation. 

Most teachers cannot return to school for additional training, 
Feldman said, because there is so much demand for secondary school 
language education they cannot be spared from actual teaching. The 
pilot proje,ct is intended to provide a way for training wherever the 
teacher lives. 

Fourteen Colorado Springs (Colo. ) Spanish teachers comprise the 
first group to try out the new study guide and group learning procedure. 
They have access to a modern language laboratory with recording and 
listening devices, and will use modern visual aids such as films. They 
will receive University credit for their work. 

Miss Joanna Jolly, Colorado Springs teacher who attended a recent 
summer language institute at CU under National Defense Education Act 
auspices, will be leader of the group. Its meetings will begin in mid- 
October and conclude about May 1, compiling 30 ‘'class” hours. 

Working with Feldman on development of the project are Mrs Lois 
Badger, director of the CU Bureau of Correspondence Study; Miss 
Barbara Schindler, director of the CU Bureau of Speech Services and 
communications consultant who has prepared a handbook section on 
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group learning procedures; Dr. Dwight L. Bolinger, CU Spanish profes- 
sor and project consultant, and Miss Dorothy Duhon, Colorado State 
Department of Education language supervisor. 

Feldman has been a staff member for the 1961 and 1962 summer 
language institutes at CU. He received a bachelor* s degree from the 
University oi Southern California and advanced degrees from Cornell 
University. He taught at Cornell and Princeton Universities before 
joining the CU staff. 



At several times during the term of the project, the Director 
also prepared a brief release, which was sent to various professional 
journals, and whose text follows: 



At the University of Colorado a new course in applied linguistics is 
being developed to give in-service training to secondary- school teachers 
oi opanish. Sponsored by the U. S. Office of Education and directed by 
Dr. David M. Feldman, the course is being offered this semester to a 
pilot group of 14 Colorado Springs teachers who will meet for fifteen 
two- hour sessions, with discussions, films, and tape- rcicorded exer- 
cises. A Study Guide has been prepared by the Director, in collabora- 
tion with the University Extension Division, which the class will follow 
in its outside readings, written assignments, and exercises. 

The^course aims to accomplish three things which heretofore have 
been available only to those free to attend summer institutes or the even 
rarer all-year institutes: familiarize the participants with the findings 
of linguistic science, acquaint them with discussion techniques and the 
use of the Study Guide so that they in turn can lead other groups in their 
districts, and improve their own control of Spanish. 



Because of the general distribution normally given to such re- 
leases, we have no way of reporting on how widely they were dissemi- 
nated. The following announcements have, however, been brought to 
our attention. 



1 . 

2 . 

3. 

4. 



The Modern Language Journal , XL VII (March, 1963), p. 133. 
Hispania, XL VI (May, 1963), pp. 395-6. 

The Boulder Camera, Tuesday, Sept. 25, 1962 (Boulder, Colo. ). 
PMLA, LXXVIII (March, 1963), p. xiv. 
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5, Ivory Basement News, No. 45, January, 1963, p, 6, 

Daily News , October 13, 1962 (Lamar, Colorado). 

7, Grand Junction Sentinel, October 24, 1963 (Grand Junction, Colo. ). 
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PROFICIENCY TEST 
RESULTS 



APPENDIX IV 



The evaluation of the results of the Modern Language Association 
Proficiency Tests for Teachers and Advanced Students as a mirror of 
participants’ progress during the Pilot course is a difficult task, prin** 
cipally because only now a kind of national ’’standard” is emerging from 
the combined results of these tests since they were first given. Thus, 
the real significance consists in the relative amount of progress made 
by a given participant, based upon a comparison of his score on the pre- 
test with that on the post-test* For additional comparative accuracy, 
we have drawn a statistical parallel between the test results of our Pilot 
group cind the means for the 1962 Summer Institutes in the same testing 
areas: Applied Linguistics and Professional Preparation. 



In exeimining these scores, it must be remembered that an eight- 
week Summer Institute, such as the one held at the University of Colo- 
rado, provides some 72 hours of contact class work in Applied Linguis- 
tics and Professional Preparation, in addition to another 72 hours cf 
courses in which principles and methods are demonstrated. Our Pilot 
Project demanded but 32 hours of participant time, at an hour which 
found them tired after a full teaching day. A further difference exists 
in the manner of selecting participants. While the Institutes have a 
selective procedure f^r choosing among applications, we accepted all 
the teachers in the district who wished to participate, regardless of 
their qualifications. This is, cf course, one of the essential advantages 
of this approach, but it does affect the means extracted from combined 
test results and often slows down the class discussion. 



In Table A, the results from the pretesting and post-testing are 
compared, to demonstrate the relative progress of individual partici- 
pants in each area tested. Improvement was significant except in two 
cases, participants 1 and 7 in Applied Linguistics. The first of these 
participants was one who felt somewhat coerced into participating and 
made no particular effort to do well either on the tests or during the 
course. The second was confused by the material which, she said, was 
presented too fast for her to grasp. She mentioned at the post- test that, 
in the pretests, she was certain of the answers she ’’knew"; but that, in 
the post- tests, she was completely uncertain. Thus, in the period of 
the course* s duration, only the first step in the learning process, 
doubt, was achieved. 



In Table B, the means of the Pilot course are compared with those 
of the 1962 Summer Institutes. In Applied Linguistics, the national 
means began higher. Because the principles of linguistics were the 
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focus of only one- third of the assignments, the others being more in the 
area of methodology, in our course, as contrasted with heavy emphasis 
in the Institutes, however, the relative progress is encouraging. In the 
area of Professional Preparation, the Pilot group l^egan at a higher 
point, possibly in part because of the large proportion of experienced 
teachers in the group. 






Table C presents a summary of percentile advances made between 
the beginning and the end of the Pilot course. Here, in Applied Lin- 
guistics,, the class median rose from 30-39% to 70-79%, even accounting 
for the two participants who fell in the post-testing. In Professional 
Preparation, the advance was leis, perhaps in view of our remarks 
above, but the class median did jump from 60-69% to 70-79%. 



Table D shows how many percentile ranks were advanced by indi- 
vidual participantSs • . 



Table E is signif?caht because of what we have tentatively termed 
the ’’minimum standa. J.” effect of the Project. Compared with National 
Institute means, half the Pilot group began in the lower 50% of the 
tested teachers in the nation, .At the end of the Project, all participants 
rose to at least the upper 50% in Professional Preparation, and all but 
two, or almost 82%, rose to at least the upper half in Applied Linguistics, 
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TABLE A 



Results of the MLA Foreign Language Proficiency Tests for Teachers and 

Advanced Students 



PROFESSIONAL PREPARATION 


APPLIED LINGUISTICS ' 


1 - _ . .. 1 .. .. 1 IL 1 1 

pretests 


post-tests 


pretests 


post- 


-tests 


Partic- 


C. S.’J' 


%-ile 


C.S. * 


%-ile 


C.S.* 


%-ile 


C.S.« 


%-ile 

rank 


ipants 


rank 


rank 


rank 
















i 


f 


1. 


62 


59 


62 


59 


43 


53 


37 


21 


2. 


72 


94 


72 


94 


38 


26 


44 


57 


3. 


56 


32 


64 


68 


49 


77 


51 


83 


4. 


64 


68 


66 


76 


44 


57 


46 


65 


5. 


64 


68 


66 


76 


56 


93 


56 


93 


6. 


64 


68 


69 


86 


39 


31 


49 


77 


7. 


56 


32 


62 


5^ 


39 


31 


35 


13 


8. 


60 


49 


64 


68 


40 


36 


50 


80 


9. 


69 


86 


71 


91 


36 


16 


44 


57 


10. 


57 


37 ,. 


67 


79 


40 


36 


50 


80 


11. 

,. 


55 


92 


64 

1 


68 

1 


64 


68 


53 


87 



’J'Converted Score 



TABLE B 



Comparison of Converted Scores Between Project and the 1962 All-Institute 

Means 



APPLIED LINGUISTICS 


PROFESSIONAL PREPARATION 


1962 All-Institute 


Project 


1962 All-Institute 


Project 


Means 


Means 


pretests 


post-tests 


pretests 


ipost-tests 


pretests 


post-tests 


pretests 


post-tests 


43. 6671 


49. 5861 


43.545 


46.8"l8 


59. 3064 


67.0427 


62. 4000 


66.091 
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TABLE C 



Number of Participants in Percentile Rank, Generalized in 10% Grades 



Applied Linguistics 


%-ile Rank 


pAofessional Preparation 


pretests 


post-tests 




pretests 


t 

post-tests 


f 


/ 


90-100 


ll 


ll 




nil 


80-89 


1 


. / 


/ 


1 


70-79 ~ 




in 


/ 


1 


60-69 


III 


hi 


// 


ll 


50-59 


1 / 


n 






40-49 


/ 




ilil 




30-39 


III 




i 


1 


20-29 






J 


1 


10-19 










0-9 






30-39 




70-79 


Average 


60-69 


70-79 
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TABLE D 



Number .of Participants Changing Percentile Rank 



f — ■ " 

Professional Preparation 


No. of %-iles 


Applied Linguistics 




'■5 


// 


/ 


•4 


11 


// 


3 


/ 


/// 


2 


/ 


/// 


1 


// 


// 


0 


/ 




-1 






•• 2 


/ 




- 3 

- _ - 


/ 



TABLE E 



Number of Participants Rising From Low^r Half of Percentile Ranking 

to Upper Half 



Professional Preparation 


Applied Linguistics 


Began in lower. half 
4 of 11 


Began in lower half 
6 of id 


Began in upper half 
7 of 11 


Began in upper half 
5 of 11 


Rose from lower to upper half 
4 of 4 


Rose from lower to upper half 
4 of 6 


Total in upper half at end of course 
j 11 of 11 


Total in upper half at end of course 
9 of 11 
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Name 


Level of 
School Taught 


Level of 
Spanish Taught 


No. Span. 
Classes 


Miss Lucille M. Arnold 


Junior High School 


None 


None 


Mrs. Gladys M. Chase 


Junior High School 


First Year 


Three 


Mrs. Rebecca Gentle 


High School 


First, Second, 
Third Years 


Five 


Mr. Robert Hall 


Junior H^gh School 


First Year 


Two 


Mrs. Elizabeth M. Hill 


Junior High School 


First Year 


One 


Mrs. Emma M. Kinner 


Junior High School 


First and Second 
Years 


Four 


Mrs. Mary Ann Lane 


High School 


First and Second 
Years 


Five 


Miss Margaret M. Lee 


Junior High School 


First Year 


Three 


Mrs. Aileen McNamara 


High School 


First and Second 
Years 


Five 


Mrs. Doris G. Moon 


Junior High School 


First Year 


One 


Miss Jeneane Price 


Junior High School 


First Year 


One 


Miss Helen E. Rohrer 


High School 


First Year 


Two 


Leader 








Miss Joanna Jolly 


High School 


Second, Third, 
Fourth Years 


Four 



❖Completed the course. 
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